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FILTERING  WITH  TWO  SIDED  FILTRATION S 


ROBERT  J.  ELLIOTT 

Department  of  Statistics  and  Applied  Probability,  Univer¬ 
sity  of  Alberta,  Edmonton,  Alberta,  Canada  T6G  2G1 


Abstract  The  value  of  a  diffusion  at  an  intermediate 
point  is  observed  through  noisy  observations  on  each  side. 
Corresponding  semimartingale  decompositions  and  recur¬ 
sive  filtering  equations  are  obtained. 

1.  INTRODUCTION 

Suppose,  a  signal  process  xa  is  observed  through  a  noisy  observation 
process  y,  for  s  €  (0, 1],  A  situation  is  c  msidered  where  the  observa¬ 
tions  y ,  are  known  both  for  0  <  s  <t  <  1/2,  giving  a  cr-field  Yt,  and 
for  1/2  <  1  —  t  <  s  <  1,  giving  aa-field  Z i_*,  and  we  wish  to  estimate 
xi/2  say,  or  some  function  F(x\/ 2)  of  aq/2-  In  mean  square  the  best 
estimate  is 

E[F{xl/2)\YtV  Zi-t] 

and  a  recursive  form  of  this  estimate  is  obtained.  Such  problems 
possibly  arise,  in  reconstructing  images  from  noisy  data  if  one  wishes 
to  estimate  the  signal  at  linear  location  1/2  based  on  observations 
from  0  to  t  and  1  - 1  to  1  either  side.  This  estimation  involves  the  two 
CT-fields,  Yt,  increasing  in  the  positive,  t  direction,  and  Z\-t  increasing 
in  the  negative  t  direction.  When  x  and  y  are  diffusions  the  recursive 
equation  for 

jE[F(*i/2)|r«vZi_,] 

is  derived  below.  Detailed  calculations  can  be  found  in  [4]. 

The  construction  is  related  to  the  decomposition  of  diffusions 
with  respect  to  enlarged  filtrations,  and  to  Brownian  bridges.  To 
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illustrate  the  methods  the  decomposition  of  a  Brownian  motion  with 
respect  to  a  two-sided  filtration  is  first  obtained. 

2.  BILATERAL  BRIDGES 

The  technique  below  was  first  used  by  Ito  [5]  to  discuss  the  reverse 
time  decomposition  of  a  Brownian  motion. 

Convention  2.1.  We  shall  assume  all  filtrations  are  complete 
and  right-continuous. 

Suppose  {l?i},0<i<lisa  standard  Brownian  motion  on 
(fi,F,P).  Write 

Ft  =  o{B,  :  0  <  s  <  t) 

G,  =  o{B,  :  t  <  s  <  1} 

and,  (see  Convention  2.1),  consider  the  forward  and  backward  filtra¬ 
tions  {F<},  {G*},  0  <  t  <  1.  For  0  <  t  <  ^  consider  the  two-sided 
filtration  {Ft  V  Gi_4}  =  {Ht}. 

Lemma  2.2.  For  0  <  t  <  B  is  a  {Htj  semimartingale  with 
a  decomposition 

n  [*  Bu  ~  Fl-u  j 

Bl=M'~  1  1-2 ~  d“' 

Here  M  is  a  {Ht}  Brownian  motion..  Similarly,  for  0  <  t  <  - 

Bl_,. ir. +jr  *£%=**, 

where  M  is  a  {F( }  Brownian  motion  independent  of  M. 

Proof.  Suppose  0  <  t  <  —  and  t  <  s  <  1  —  t.  Any  Markov 

process  is  a  Markov  field,  (see  the  work  of  Jamison  [6]  on  reciprocal 
processes)..  Therefore,  by  the  Markov  field  (or  reciprocal  process) 
property: 


E[B,  |  Ht]  ■-=  E[Ba  |  Bu  =  E[B,  |  Bu  Bt  - 

The  random  variables  are  Gaussian  and  Bt,  Bt  -  B j_(  are  inde¬ 
pendent,  so  this  conditional  expectation  is  a  projection  and  equals 
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3t  +  ~  Consequently,  E\Bt+h  -  Bt  \  Ht\  = 

_h  r(i/2)-« 

~ -  Bi.t).  Therefore,  jf  E\E[Bt+H  -  Bt  |  Ht]\dt  = 

0(h)  and  so  from  Theorem  2  of  Strieker  [8],  (see  Theorem  3.10  below), 
B  is  a  [Ht]  quasimartingale  with  a  unique  decomposition: 


=  Mt  +  /  audu; 
Jo 


here  M  is  a  {Ht)  martingale..  Now 


E[Bt+h  ~Bt  \Ht]  =  E[J  +  audu  \  Ht 


(1-2  0 


(Bt-Bt-t) 


so  dividing  by  h  >  0  and  letting  h  -*  0  we  see  at  =  -  — . 

Furthermore,  because  the  quadratic  variation  of  bounded  variation 
terms  is  zero  the  quadratic  variation  process 


<*),  -  W.  =  |Km  X) 

N  2 


=  t  —  s, 


where  the  Hmit  in  probability  is  taken  over  partitions  II  —  {s  <  to  < 

t  <•■••<  tpi  —  t)  oi  [s,  t]  C  [0,  -j-j)  and  )/7|  =  max  |tl+i  —  Therefore 

2  • 

{ Mt }  is  a  continuous  {Ht}  martingale  with  ( M)t  =  t  and  so  M  is  a 
{Ht}  Brownian  motion. 


/'a„< 

Jo 


Similarly  Bt  =  2?i_t  =  M  +  /  audu  where  M  is  a  {Ht}  mar 
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tingalc.  In  fact 

ElBx-t-k  -  B^t  |  Ht)  =  £[£,_,_*  -  i?i_<  |  Bt,  Bt  -  £,_<] 

=  B'  +  Irrr *^<ft-ft-.>-ft-. 

t+h 


(1-21) 


(B,  -Bi-i)  =  £[  J  audu  |  Btj . 

,  ,  _  B,-B,_,  ,  „  —  ,  /•' B„-B , 

As^above,  a,  =  (1  _  a)  and  B,_,  =  M,  +  ^  Y-27  d“ 

where  M  is  a  {I/*}  Brownian  motion. 

The  random  variables  M,  M  are  Gaussian,  so  to  establish  inde¬ 
pendence  it  is  sufficient  to  show  they  are  orthogonal.- 

-£[(*  +  *) 

[*  t  —  u  flt  +  u  —  1  , 

=t+l—udu+l-r^rdu 

-2  jsf/y  /•*•-*-  ds)B-u~-f-?  du 

I  Jo  \Jo  l  — 2s  J  1-2 u 

=  ‘  +  (2<_1)/T^k”2/(l  T^s)'i" 

=t+(2‘~1)lr^i~2l  {j^ds 


0. 


The  Brownian  motions  M  and  M  are,  therefore,  independent. 


3.  SEMIMARTINGALE  DECOMPOSITIONS 

For  0  <  t  <  1  consider  an  n-dimensional  Brownian  motion 

I?  =  (2?1, .  .  ., 2?n)  defined  on  a  probability  space  (f l,F,P).  Suppose 
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the  functions  a',  g,}  belong  to  Coc(Rd)  and  satisfy  growth  conditions 
of  the  form 

£  kwi1 +EE  i /'wi*  <  /^(i  +  ixi2). 

«=1  t=l  ;  =  1 

Consider  the  associated  vector  fields 

/i(*)= x„(z) = £>•*(*) 


for  1  <  fc  <  n,  and  a  second  order  operator 

W  =  ^E(X>W‘(*))^.  (3.!) 

«,J=1  Jt-1  J 

Suppose  an  initial  condition  x0  is  given  which  is  an  /^-valued  random 
variable  independent  of  Bf  —  B*  for  0  <  s  <  t  <  1,  1  <  k  <  n,  and 
independent  of  the  observation  process,  (see  3.3  below). 

Signal  3.1.-  Consider  a  signal  process  which  is  the  solution 
of  the  system 

n 

dxt  =  A(xt)dt  +  Y  Xk(xt )  0  dBt  -  (3-2) 

*=i 

Here  odD  denotes  the  Stratonovich  integral.  For  any  C3  function 
<f>-.Rd->R 

=  <f>(x0)+  /  A(xu)<f>(xu)du  +  V  f  Xk(xu)<l>(xu)<id3*.  (3.3) 

Jo  k=i Jo 

The.  Ito  integral  form  of  (3.3)  is 

<j>(xt)  =  <f>(x0)  +  f  L(xu)<f)(xu)du  +  Y  l  Xk{xu)(/>(xu)dD *.  (3.4) 
Jo  k=]J  o 

Notation  3.2.  For  0  <  t  <  1  write  (i7)},  resp.  {F</,  for  the  right 
continuous  completion  of  the  filtration  generated  by  a{x„  :  0  <  s  <  t}, 
resp.  a{x0,  Dv  -  Du  :  0  <  u  <  v  <  t}. 
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Similarly,  {(?<},  resp.  {(?*},  will  denote  the  right  continuous 
completion  of  the  (reverse  time)  filtration  generated  by  o{xg  :  t  < 
s  <  1},  resp.  cr{x j,  Dv  —  Du  :  t  <  u  <  v  <  1}. 

If  /(u),  0  <  «  <  1,  is  a  {G|}  predictable  process,  continuous 

in  probability  and  such  that  J  E[f{u)2\du  <  oo,  the  backward  Ito 
integral  is  defined  by  Kimita  [7]  as 

Here  77  —  {s  —  to  <  t j  <  <  t^j  —  t)  is  a  partition  of  [s,t\  and 

|77|  =  max  \tj+1  -tj\. 

As  in  Elliott  and  Anderson  [3],  a  reverse  time  Ito  integral  form 
of  (3.2)  is 

Xt=Xl  +  Ji  Hxu)du  +  XJ  Xk(xu)dB*  (3.5) 


where  L(x)  =  A{x)  -  \  ^  (  X)  9'k(x)9,k(x))  • 

Observation  3.3.  The  signal  process  is  not  observed  directly  but 
via  a  noisy  observation  process  {yt}  where 


Vt 


=  /  h(xu)du 
Jo 


+  wt,  for  0  <  t  <  1. 


(3.6) 


Here  yt  €  72m  and  w^w1,. . .  ,wm)  is  an  m-dhnensional  Brownian  mo¬ 
tion  on  (il,F,P)  which  is  independent  of  B  and  2o- 
Write 


£»  =  £>■(*) 

«=l 


d 2 
dy 2, 


d 2 


and  Zy  =  V  h'(x)~ - ^  y  ■  , . 

7  '  dy,  2  dy 2 


/—j 

«=i 


t=i 


Then  if  ip  Rm  —>  R  is  any  C 2  function 


ft  m  ft 

i(Vt)  =  </>(0)  +  J  Lyip(yu)du  +  Ylj 


dip 

dy. 


(yjd 


w„ 


(3.7) 
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Notation  3.4.  For  0  <  t  <  1  write  {Fi},  resp.  {F<},  for  the 
right  continuous  complete  filtration  generated  byer{?/,:0<s<f}, 
1  resp.  cr{w3  :  0  <  s  <  t},  and  Zt,  resp.  Zt ,  for  the  right  continuous 
completion  of  the  filtration  generated  by  cr{y,  :  t  <  s  <  1},  resp. 
{in,  wa-wi  :t<s<  1}. 

Remark  3.5.  Although  {y<}  is  not  a  Markov  process,  {xj,y*}  is 
Markov. 

We  shall  require  the  following  hypotheses  satisfied: 

Hypotheses  3.6.  Suppose  the  diffusion  {xt,y*}  is  such  that: 

1.  For  each  t  £  [0, 1]  there  is  a  smooth  density  g(t,x,y)  of  (x;,yf). 

2.  For  each  s,t  £  [0, 1],  s  <  t,  there  is  a  smooth  transition  density 


p(x  3,ys,  X(  ,yt,  s,t). 


3.  If  «•(<.*.»)  =  -(divX.(*)  +  /,/0M^) 

and  A k(t,  x,  y)  =  x,  y)  ■  q(t,x,y)~l 

oyk 

then  k'  and  A*  £  Ll({6 , 1]  x  12)  for  any  6  >  0, 

4.  k‘  and  Xk  £  L(oc([6, 1]  x  12)  for  any  6  >  0. 

5.  Consider  p(x.  y,£,  (,s,t)  and  write 


for  1  <  i  <  n, 
for  1  <  k  <  m. 


4(*,y,4,C>M)  =  Jr  -p-1- 

Then  £*(x(,  yt,  x,_t,  yj_t,  2,  1  -  <)  £  TJ([0>  ^  -  6]  x  12)  and 

**(**,  yt,  xi-t,  yi-t,  t,  1  -t)  £  -6]  x  12)  for  any 

6  €  (0,  ^),  1  <  A:  <  m. 

From  Elliott  and  Anderson  [3]  we  can  quote: 

Theorem  3.7.  Under  Hypotheses  3.6(1),  (3)  and  (4) 

{Bt  -  Bi)  =  {B)  -  D\ , , B"  -  B\'} 


{wt  -  uq }  =  {uq1  -  tyj , , . . ,  w”'  -  ru\n } 


and 
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a rc  reverse  time  {GtVZt}  quasimartingales.  In  {net,  if  13}  =  B}  —  B J  — 
K'(u,xlnyu)du  fori  <  i  <  n,  andw*  =  wf  —  wf  —  A k(u,xu,yu)du 

for  1  <  k  <  m,  then  {B,  to}  is  ait  n  -f  m  dimensional  {G<  V  Zt}  Brow¬ 


nian  motion. 


Notation  3.8.  Consider  now  the  two-sided  cr-fields  for  0  <  t  < 


Ht  =  Ft  V  Gi-t  and  Ht  =  Ft  V  Gj_(  for  the  signal  x, 

Kt  =  Y,  V  Zi-.t  and  I\t  =  YtV  Zi_(  for  the  observation  y,  and 


I 


Ht  V  Kt,  Ht  V  Kt  for  ( x ,  y). 

In  a  manner  similar  to  [1]  and  Section  2  we  shall  now  determine  the 
semimartingale  decompositions  of  {wt}  and  {tot}  =  {uq_t  —  uq}  with 
respect  to  the  filtration  {Ht  V  A'*}. 

Theorem  3.9.  Suppose.  Hypotheses  3.6  are  satisfied.  Then  for 
1  <  k  <  m 

lim  /t_1£(ui^+/l  -  W(  |  Ht  v  kt\  -  £k(xt,  yt,  *i ~t,  yi-t,  t,  1  -  t) 

k  — 0-f 

(3.8) 

weakly  in  Ll(fl). 

If  wt  -■  uq_<  ~  uq, 

Kw+h-'Elw^-wpH.VK,! 

=  lim  frlE[wk1.h  -  w\_.  I  Ht  V  kt] 

0  + 

=  £*(**,  yt,  Xj -t,  yi-t,  t,  1  —  t)  (3.9) 

weekly  in  Ll(Q). 

Note  the  right  hand  sides  of  (3.8)  and  (3.9)  are  Ht  V  Kt  measur¬ 
able,. 

Proof.  The  proof  uses  the  reverse  time  differentiation  rule  and 
Strieker’s  characterization  of  quasimartingales  ([8],  Theorem  2).  De¬ 
tails  can  be  found  in  [4] . 

We  then  have 
Theorem  3.10..  Write 


t=(p,...  ,<■). 
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Then  {to,}  and  {to,}  an-  {Ht  V  A', }  quasiir artingales  with  decompo¬ 
sitions 


=  fit  +  /  t{xu,  Vuy  xi-u,  Vi-u,  u,  1  -  u)du 

Jo 

to,  =  toi_,  =  /?,+  /  l(xu,  yu,  X!_U)  t/i_u,  u,  1  -  u)du. 
Jo 


Here  (3  and  (3  are  independent  m- dimensional  {Ht  V  A,}  Brownian 
motions. 


4.  BILATERAL  FILTERING 

Notation  4.1.  Tl  will  denote  the  predictable  projection  with 
respect  to  the  two-sided  complete,  right  continuous  filtration  {A,} 
generated  by  ys,  0  <  s  <  t,  and  1  —  t  <  s  <  1.. 

The  ‘forward1  part  of  the  observation  process  is 


yt=  h(xu)du  -f  to,.  (4.1) 

Jo 

With  respect  to  the  filtration  {//,  V  A^,}  this  can  be  written 

!/<  -  /  h(xu)du+  [  £(u)du  +  (3t  (4.2) 

Jo  Jo 

where  (3  is  an  \Ht  V  AT, }  Brownian  motion.  Taking  the  { Kt }  projec¬ 
tions  this  can  be  expressed  ar 

y,  =  /  JIh(xu)du+  f  r/£(u)du  +  i'f  (4.3) 

Jo  Jo 

Here  i/,  is  {Ar,}  adapted  and 

i/,—  f  (h(xu)  —  lJh(xu))du  +  f  (£(u)  —  n£(u))du  +  fit., 

Jo  Jo 

Therefore,  u  is  a  continuous  {A,}  martingale.  As  in  [2]  the  product 
rule  show  that 


v>)t  =  (U\  F)t  =  6t,i 
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for  1  <  t,  j  <  77i,  so  1/  is  a  {JC}  Brownian  motion.  Now 

f1 

Vi  =  I  h(xu)du  +  wt. 

Jo 

Consequently  the  ‘reverse  time’  part  of  the  observation  process  can 
be  written 

Vt  =  yi-<  =  !/i  -  /  h(xu)du  +  w^t  -  wl 

Ji-t 

=  J/i-  f  h(xu)du+  f  C(u)du  +  fit 
J\-t  Jo 

=  yo  -  /  h(xi-u)du+  f  £(u)du  +  j3t.  (4.4) 

jo  jo 

Taking  the  { A"t }  projection  this  can  be  written 

Vt  =  j/o  -  /  nh(xi-u)du  +  f  nt(u)du  -f  i>,  (4.5) 

jo  Jo 

where,  as  above,  i>  is  a  {JC<}  Brownian  motion  independent  of  u 
We  can  now  derive  the  bilateral  prediction  formula: 

Theorem  4.2.  Consider  the  signal  and  observation  processes 
determined  by  (3.2)  and  (3.6),  respectively.  Suppose  F  is  any  real 
valued  C 2  function  with  compact  support  defined  on  Rd.  For  0  <  s  < 

-  write 

2 

A,  =  E[F(x1/2)  |  V  A'J. 


Then 


n(At)  =  E[F(xl/2)  I  Kt] 


=  II(\0)  +  £{n(Au(h(xu)  +  e(u))) 
-n{Au)(n(h(xu))  +  n{£(u)))}dvu 

+  ff  (ajJ(u)  —  /i(x,_u))) 

+  77(Au)(/7(/<*i-«))  -  /7(l(ti)))}di/u. 
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Proof.  First  note  that  A  is  introduced  for  notational  convenience 
and  because,  for  example, 

n(\t)  =  E[F(x1/2)\Kt} 

n(Au(!(u)))  =  E[E[F(x1/2)  I  Hu  V  Ku)iu  I  Ku) 

=  E[F(x1/2)e(u)  j  Ku] 

the  final  equation  could  be  written  just  in  terms  of  F( X\f2). 

A<  =  E[F(xi/2)  |  Ht  V  Kt]  (4.6) 

is  a  martingale  by  definition  and  77( A()  =  E[F(x\/2)  \  Kt]  is  a  {Kt} 
martingale.  Now  A  is  the  solution  of  a  prediction  or  smoothing  prob¬ 
lem,  and  as  in  Theorem  16.22  of  [2],  A <  has  a  representation  as  a 
stochastic  integral. 

A<  =  A°  +  l  a  udBu  +  ^  audBu.. 

The  nature  of  the  integrands  a,  at  could  be  investigated.  However, 
this  would  not  contribute  to  the  solution,  because  what  is  required  is 
a  recursive  expression  for  J7( At).:  Now  again,  77 (At)  has  a  represen¬ 
tation  as  a  stochastic  integral.. 

7J(A,)  =  77(A0)  +  /  r^dvu  +  /  7.  duu.  (4.7) 

Jo  Jo 

We  wir;h  to  determine  the  processes  7  and  7.  Forming  the  products 
of  A  with  (4.2)  and  (4.4) 

A tVt  =  /  Au/j(xu)du+  /  A U£(u)du 
Jo  Jo 

+  /  Aud(3u  -f  /  yud Au-f(A,y)(  (4.8) 

Jo  Jo 

Atyt  =  A0y0-  /  Auh(xi-U)du  -f  /  A Ul{u)du 
Jo  Jo 

+  /  Aud$u  +  /  yudAu  +  (A, y)r  (4.9) 

Jo  Jo 
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However,  because  (B,y)  =  0,  {B,  y)  =  0,  the  quadratic  variation 

terms  in  (4.8)  and  (4.9)  vanish.  Taking  the  {Kt}  projection  of  both 
sides  of  (4.8) 


n(Atyt)  =  /7(At)y« 


-i: 


77(Au(/i(xu)  -f  £(u))du  +  M( 


(4.10) 


where  M  is  a  {/{^-martingale,  Similarly,  taking  the  { Kt }  projection 
of  both  sides  of  (4.9): 


n(Atyt)  =  n(At)y  =  IJ(A0)yo 

+  f  77(Au(£(u)-  h(x^u)))du  +  Mu 
Jo  (4.11) 

where  M  is  a  {A'(} -martingale.  However,  if  we  take  the  product  of 
77(Af),  as  given  by  (4.7),  and  (4.3) 

n(At)yt  =  fn(Au)(nh(xu)  +  ne(u))du 

Jo 

yu~(udvu  +  /  yujuduu  +  /  7 Udu  +  Nt 

Jo  Jo,  (4-12) 

where  N  is  a  {At}  martingale.  The  stochastic  integrals  with  respect 
to  v  and  v  are  also  { /Ct }  martingales.  The  process  lJ(At)yt  is  clearly  a 
special  semimartingale,  so  the  decompositions  (4.10)  and  (4.12)  must 
be  the  same. 

Equating  the  bounded  variation  terms  we  have 


7 1  =  n(At(h(xt)  +  £(t)))  -  n(At)(nh(xt)  +  m(t)).  (4.13) 

Similarly,  forming  the  product  of  (4.7)  and  (4.5): 

Il{At)yt  =  IJ(A0)y0  +  [  77(Au)(i7f(u)  -  77/i(xi_u))du 

Jo 

+  /  Vuludvu  +  /  yu%disu  +  /  7 Udu  +  Nt. 

Jo  Jo  Jo  (4.14) 
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Again,  the  decompositions  (4.11)  and  (4.14)  must  be  the  same,  so 
equating  their  bounded  variation  terms  we  see 

it  =  n(At(C(t)  -  /*(*!_,)))  +  n(At)(rih(x^t)  -  ni(t)).  (4.15) 

Substituting  (4.14)  and  (4.15)  into  (4.7)  the  result  follows. 
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